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FOREWORD 


This  operational  specification  for  computer-directed  training  in  man- 
computer  communication  was  prepared  for  Decision  Sciences  Laboratory  in  sup¬ 
port  of  the  473L  System  Program  Office.  Dr.  Sylvia  R.  Mayer  of  Decision 
Sciences  Laboratory  served  as  task  scientist  and  contract  monitor,  and  Major 
Jack  H.  Leith  of  the  473L  System  Program  Office  served  as  personnel  subsys¬ 
tem  manager.  This  study  was  conducted  under  Task  768204,  Automated  Training 
for  Information  Systems,  under  Project  7682,  Man-Computer  Information 
Processing. 

Contract  support  was  provided  by  the  American  Institute  for  Research 
with  Mr.  Harris  H.  Shettel,  principal  investigator,  and  Mr.  David  P.  Yens. 
The  technical  guidance  and  support  provided  by  Mr.  Anthony  Jordano  and 
Mr.  Robert  Meyer  of  the  IBM  Federal  Systems  Division,  Mr.  David  Miquelon  of 
Dunlap  and  Associates,  and  Major  Robert  Evans  of  the  USAF  Command  Post  are 
gratefully  acknowledged. 


ABSTRACT 


This  specification  describes  the  projected  Query  Language 
Computer-Directed  Instruction  program  which  permits  active  on- 
console  training  of  personnel  in  the  writing  and  processing  of 
OTC  Query  Language  statements  in  System  473L.  The  files,  programs, 
and  processes  of  the  program  and  a  sample  computer- trainee  interaction 
are  detailed.  General  flow  charts  for  a  possible  computer  program 
implementing  the  specifications  are  provided,  designed  for  the  IBM 
1401  or  1410  computer . 


PUBLICATION  REVIEW  AND  APPROVAL 

Publication  of  this  technical  documentary  report  does  not  constitute 
Air  Force  approval.  This  report  is  published  for  experimental  use  in 
training  Air  Force  personnel  in  man-computer  communication  techniques. 
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Chapter  1 


INTRODUCTION 

This  Operational  Specification  describes  an  instructional  program  for  the 
Operational  Training  Capability  (OTC)  Query  Language  on  the  Computer  Communica¬ 
tions  Console  and  the  IBM  1410  computer.  It  is  recognized  that  some  redesigning 
will  be  necessary  to  apply  these  Operational  Specifications  to  the  Mod  I  and 
II  Query  Language  on  the  AN/FYA  -  2  Integrated  Console  and  3055  computer,  equip¬ 
ment  which  is  now  being  readied  to  replace  the  present  equipment  in  the  473L 
system.  However,  the  basic  strategy  of  instruction,  and  the  role  played  by 
the  computer  to  implement  this  instruction,  will  remain  essentially  as  docu¬ 
mented  here. 

The  Query  Language  Computer  -  Directed  Instruction  program  was  developed 
to  meet  the  need  for  a  method  to  train  Air  Force  personnel  to  prepare  and 
process  473L  OTC  Query  Language  statements  with  speed  and  proficiency.  A 
computer-directed  program  provides  a  large  degree  of  flexibility  by  tailoring 
the  training  procedure  to  the  needs  of  each  individual  trainee,  and,  at  the 
same  time,  provides  actual  experience  with  the  Computer  Communications  Console. 

The  computerized  training  program  is  designed  to  permit  trainees  to  type 
and  enter  Query  statements  directly  into  the  computer,  followed  by  feedback 
on  the  correctness  of  the  entry.  An  incorrect  answer  would  be  followed  by  a 
description  of  the  error  and  corrective  material;  the  problem  would  be  presented 
again  and  the  cycle  would  start  over.  On  the  whole,  the  computer  would  react 
to  the  trainee  in  a  manner  very  much  like  a  human  tutor,  accepting  correct 
answers  and  reteaching  those  items  on  which  an  error  was  made. 

As  stated  in  the  contract  for  the  development  of  a  QL  (Query  Language) 
instructional  package,  the  computer-directed  instruction  should  "...  develop 
operator  proficiency  on  the  ...  keyboard,  and  provide  intensive  controlled 
practice  in  keyboard  operation  and  output  interpretation.**  This  can  be  achieved 
only  by  providing  interaction  between  the  trainee  and  the  equipment.  The  con¬ 
trol  of  the  interaction  basically  lies  with  the  computer,  just  as  it  would  were 
a  human  tutor  used  in  place  of  the  computer.  However,  in  the  QL  Instruction 
program,  the  trainee  is  allowed  some  control  over  the  instruction  through  the 
use  of  a  specialized  input  called  the  overlay  mode.  In  effect,  the  trainee  is 
frequently  presented  with  a  choice  of  alternate  ways  to  continue  the  instruction 
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which  are  implemented  via  this  overlay  mode  (or  process  step  keys,  as  they  are 
called).  These  keys  also  permit  him  to  override  portions  of  the  program  at 
certain  specified  stages  of  instruction.  However,  the  program  has  been  de¬ 
signed  so  that  it  would  be  difficult  for  a  trainee  to  miss  needed  instruction 
or  create  a  false  impression  of  ability.  A  sample  man-machine  interaction  is 
described  in  Section  3.6. 

Prior  to  the  beginning  of  the  computer-directed  instruction,  the  trainee 
will  have  undergone  approximately  35  hours  of  training  with  a  programed  text 
covering  the  QL  vocabulary  and  syntax  and  will  have  written  a  number  of  basic 
QL  statements.^ 

In  addition,  before  the  trainee  is  allowed  to  start  his  work  with  the 
computer,  he  will  be  given  a  brief  written  textual  program  to  prepare  him  for 
this  unique  form  of  training.  This  "preprogram"  will  familiarize  the  trainee 
with  the  structure  of  the  instruction  program  and  the  various  options  available 
to  him  and  how  they  are  controlled  through  the  use  of  the  overlay.  It  will 
also  teach  him  the  meaning  of  the  different  cues  and  displays  which  will  appear 
on  the  CRT  and  the  method  by  which  he  should  respond  to  them. 

The  first  element  of  the  computer-directed  instruction  itself  is  a  pre¬ 
test  that  consists  of  a  set  of  ten  English  requests  (problems)  from  which  the 

trainee  is  to  write  QL  statements  and  enter  them  into  the  computer.  This  pre¬ 
test  serves  two  functions:  (1)  to  assess  the  trainee’s  ability  to  write  the 
statements;  and  (2)  to  give  the  computer  basic  information  from  which  it  can 
organize  and  present  to  the  trainee  an  optimum  training  sequence. 

The  second,  and  larges t,  element  of  the  program  is  the  instructional  material. 
This  material  is  based  upon  20  fixed  problems  of  increasing  difficulty  from 
which  the  trainee  must  compose  and  enter  appropriate  Queries.  At  specified 
points  during  the  sequence,  the  trainee  may  elect  remedial  sequences  of  dif¬ 
ferent  kinds.  If  a  problem  is  incorrectly  answered,  the  appropriate  remedial 
sequence  is  presented,  based  essentially  upon  the  kind  and  magnitude  of  the 
error  and  the  trainee’s  performance  preceding  the  error. 

^OTC  Query  Language  (Self-Instructional  Course) .  (ESD-TDR-64-443  Vol.  I-XXIII) 
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The  third  and  final  element  of  instruction  is  a  test  set  of  ten  problems.  The 
problems  will  represent  criterion  behavior  and  must  be  answered  in  a  minimum  amount 
of  time.  No  assistance  other  than  that  normally  provided  an  operator  will  be  per¬ 
mitted.  If  the  trainee* s  performance  on  the  test  problems  is  satisfactory,  the 
problems  are  presented  sequentially  until  completed,  at  which  point  the  trainee 
’‘graduates  .**  However,  if  the  trainee's  overall  performance  is  less  than  satisfactory 
by  the  fifth  or  any  succeeding  problem,  remedial  sequences  are  automatically  initiated 
which  cover  the  areas  in  which  the  trainee  is  experiencing  trouble.  The  test  phase 
is  then  repeated  until  a  satisfactory  level  of  performance  is  attained. 

During  the  progress  of  the  instruction,  printouts  may  be  obtained  of  a 
trainee *s  performance.  These  would  be  useful  to  instructional  and/or  supervisory 
personnel  in  evaluating  the  proficiency  of  a  trainee  at  any  point  during  training. 

1.1  Glossary  of  Terms 

Instructional  Cue  -  The  general  class  of  cues  used  in  the  active  process 
of  instruction.  This  class  includes  all  problem  cues  and  review  cues. 

Remedial  Material  -  All  material  that  is  generated  either  by  an  error  made 
by  a  trainee  or  by  a  request  for  supportive  material  to  aid  the  trainee  in  the 
answering  of  a  problem.  Practice  cues,  review  sequences,  help  sequences,  and 
text  reference  displays  are  included  in  this  category. 

Problem  Cue  -  English  requests  for  information  from  which  a  trainee  com¬ 
poses  a  QL  statement.  These  may  be  broken  down  into  two  basic  classes: 

Major  Problems  -  This  class  is  composed  of  problems  given  before  and 
after  the  main  sequence  of  instruction  (pretest  problems  and  posttest 
problems)  as  well  as  the  20  primary  problems  that  are  the  basis  of  the 
instructional  sequence.  These  problems  range  from  moderately  compli¬ 
cated  to  quite  difficult. 

Practice  Problems  -  These  are  simple  problems  designed  to  high¬ 
light  a  specific  topic  of  Query  Language  such  as  the  Qualifier,  Delimiters, 
etc . 

Review  Cue  (Frame)  -  A  statement  or  question  that  requires  the  trainee  to 
fill  in  one  or  more  blank  words.  The  proper  words  can  be  determined  from  pre¬ 
ceding  material  and  the  context  within  the  sentence.  A  given  frame  is  always 
one  of  a  set  of  frames  (review  sequence)  dealing  with  the  same  topic.- 
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Text  Reference  Display  -  A  reference  that  directs  the  trainee  to  that 
portion  of  the  programed  text  which  covers  a  particular  area  of  Query  Language. 

General  Cue  or  Display  -  An  output  that  is  not  an  instructional  cue  but  is 
used  to  provide  general  infornvation  to  the  trainee  such  as  whether  or  not  an 
answer  was  correct  or  present  him  with  one  or  more  possibilities  for  continuing 
with  the  program.  The  cue  could  also  request  some  peripheral  information  from 
the  trainee  such  as  his  name. 

Latency  -  The  interval  of  time  from  the  presentation  of  an  instructional 
cue  to  the  instant  the  trainee  inserts  his  answer  into  the  computer. 

Answer  -  The  input  that  a  trainee  enters  into  the  computer  in  response  to  a 

Performance  Criteria  -  Externally  entered  values  against  which  obtained 
performance  values  for  trainees  may  be  compared  to  determine  how  well  the 
trainee  is  performing  and  to  help  determine  the  best  continuation  for  the  in¬ 
struction.  Essentially,  these  entered  values  provide  a  set  of  limits  which 
define  the  different  levels  of  performance  that  may  be  obtained  during  training. 

CCC  (Computer  Communications  Console)  -  The  console  by  which  the  trainee 
communicates  with  the  computer. 

Query  Language  Categories  -  A  breakdown  of  words ,  terms ,  and  concepts  in 
the  Query  Language.^  For  the  purpose  of  instruction,  Query  Language  is  broken 
down  as  follows  (appropriate  abbreviations  used  later  in  this  specification 
are  provided  where  necessary): 


1 . 

Process  Director  (PD) 

8. 

Compara  tor 

2. 

Qualifier 

9. 

Value 

3. 

Selector 

10. 

GCD  (Great  Circle  Distance) 

4. 

Major  Item  Primary  (MIP) 

11 . 

Sum 

5. 

Major  Item  Secondary  (MIS) 

12  . 

Title 

6. 

Delimiter 

13. 

Sorting 

7. 

Attribute 

14. 

Punctuation 

15. 

Genera  1  Rules 

For  definitions  of  QL  terms  see:  Operator  Guide  for  PTC  Query  Language  Data 
Retrieval .  Rockville,  Md.:  IBM,  Federal  Systems  Division,  26  July  1963. 


cue . 
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Chapter  2 


FUNCTIONAL  DATA  FLOW 

This  chapter  provides  a  general  description  of  the  data  flow  in  the  program, 
i.e.,  inputs,  files,  programs,  and  outputs,  with  a  brief  discussion  of  their 
interaction.  The  overall  relationship  of  these  parts  to  each  other  is  shown  in 
the  Query  Language  Computer-Directed  Instruction  Functional  Data  Flow  Diagram, 
Figure  5,  page  2-16. 

2.1  Inputs 

2.1.1  System  Inputs 

Inputs  to  the  program  exclusive  of  operator  inputs  (i.e.,  trainee  or  in¬ 
structor  inputs)  would  be  those  to  correct  or  change  existing  data  or  to  add 
new  data  as  needed.  After  the  initial  implementation  of  the  system,  however, 
there  should  be  relatively  little  need  for  data  change.  Possible  inputs  would 
consist  of  the  following  types:  cues,  displays,  latencies,  performance  criteria, 
category  codes,  answers.  These  could  be  entered  either  as  a  unit  or  individually. 

2. 1.1.1  Cues 

A  cue  is  an  output  display  to  the  trainee  that  requires  some  kind  of  input. 
There  are  three  basic  kinds  of  cues:  problem  cues,  review  cues,  and  general 
cues.  Problem  cues  are  of  two  types,  major  problems  and  practice  problems. 

Problem  and  review  cues  always  require  an  input  on  the  A/N  keyboard;  general 
cues  require  inputs  on  the  A/N  keyboard  and/or  an  overlay  key  response. 

Each  problem  and  review  cue  has  an  expected  latency,  category  code,  and 
answer  stored  along  with  it.  Figure  4  shows  a  complete  list  of  the  kinds  of 
cues^  the  stored  content  of  each  kind,  and  a  tentative  estimate  of  the  number 
of  each  that  will  be  needed.  These  latter  are  discussed  in  sections  2. 1.1. 3, 

2. 1.1. 4,  and  2. 1.1. 5,  respectively. 

A  cue  would  be  replaced  in  the  file  because  it  was  found  in  practice  to 
be  superfluous  to  the  instruction,  or  was  faulty  for  some  other  reason. 

Figure  20  (page  3-41)  depicts  a  typical  problem  cue.  Problem  cues  vary 
as  to  the  content  and  difficulty,  but  all  follow  this  general  format.  A 
typical  cue  is  shown  in  Figure  17,  page  3-38;  a  typical  general  cue(in  this 
case,  a  Procedure  Option  Cue)  is  presented  in  Figure  12,  page  3-31. 
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2. 1.1. 2  Displays 

There  are  two  kindis  of  displays,  text  reference  displays  and  comments 
(e.g.,  '*VERY  GOOD,”  ”SORRY*).  The  text  reference  displays  refer  the  trainee 
to  a  reference  external  to  the  computer.  Stored  with  a  text  reference  display 
is  its  category  code. 

Comments  inform  a  trainee  of  his  progress  or  present  him  with  some  other 
bit  of  information  relevant  to  the  instructional  sequences.  Comments  and 
general  cues  are  usually  presented  together  in  the  same  display. 

Examples  of  each  kind  of  display  are  presented  in  Figures  15  (page  3-35) 
and  21  (page  3-42)  respectively. 

Displays  might  be  changed  if  the  text  material  was  revised. 

2. 1.1. 3  Latencies 

A  latency  is  the  expected  time  a  trainee  should  take  to  make  a  computer 
response  to  a  cue.  Each  instructional  cue  has  an  associated  expected  latency 
which  is  stored  along  with  the  cue. 

Latencies  will  initially  undergo  frequent  changes  as  the  optimum  mean 
latency  is  determined  by  trial  and  error.  Thereafter  they  should  remain  stable. 
The  changes  will  be  empirically  determined  on  the  basis  of  a  sampling  of 
trainee  performance. 

2. 1.1. 4  Performance  Criteria 

The  performance  of  a  trainee  in  the  computer-directed  instruction  is  used 
to  determine  in  part  the  kind  of  instruction  he  is  to  be  given  and  his  path 
through  the  program.  Performance  is  based  upon  four  measures!  pretest  results; 
error  rate  on  instruction;  latencies;  and  length  of  time  since  the  last  instruc¬ 
tion.  Value  ranges  are  established  for  each  measure,  numbers  are  assigned  to 
each  value  range,  and  these  numbers  are  summed  to  obtain  a  general  performance 
measure.  This  general  performance  measure  is  compared  against  criteria  to  de¬ 
termine  how  well  the  trainee  is  doing.  The  same  procedure  is  used  to  determine 
how  well  a  trainee  is  doing  in  each  category  of  Query  Language.  This  arithmetic 
system  into  which  a  trainee's  scores  may  be  plugged  consists  of  criterion  values 
and  numbers  which  are  placed  under  the  ruble  of  performance  criteria. 


2-2 


Initially,  the  values  used  for  the  performance  criteria  will  be  of  the 
"best  guess"  variety,  and  may  need  to  be  empirically  changed  many  times  until 
the  program  operates  with  maximum  efficiency. 

2. 1.1. 5  Category  Codes 

Category  codes  specify  which  category  of  Query  Language  (e.g.,  MIS,  delimiter, 
etc.)  a  cue  or  display  belongs  to.  Each  cue  or  display  that  is  used  in  the 
instructional  process  has  this  associated  code  so  that  it  can  be  used  in  the 
proper  place. 

Category  codes,  once  assigned,  would  not  be  changed. 

2. 1.1. 6  Answers 

Each  cue  which  requires  a  keyboard  response  has  an  associated  answer  or 
answers  that  must  be  compared  with  the  input  from  the  trainee.  (See  Figure  1, 
page  2-12).  However,  after  the  initial  implementation  of  the  program,  it  may 
be  found  that  additional  answers  may  be  valid  for  a  given  cue.  Consequently, 
there  is  a  category  of  answer  inputs  to  fill  this  need. 

2.1.2  Operator  Inputs 

There  are  three  discrete  kinds  of  operator  (i.e.,  trainee)  inputs:  a 
response  to  a  general  cue,  a  response  to  an  instructional  cue  (i.e.,  a  problem 
cue  or  review  cue)  ,  and  a  process  step  key  interrupt  of  the  ongoing  instructional 
process.  In  addition,  an  instructor  can  request  a  printout  of  a  trainee’s 
record.  The  CCC  Procedural  Flow  Diagram,  Figure  32  (page  A-3)  indicates  the 
options  possible  for  the  operator  at  each  stage  of  instruction. 

2. 1.2.1  Response  to  General  Cue 

A  general  cue  (2. 1.1.1)  requires  a  keyboard  or  process  step  key  response 
on  the  part  of  the  trainee.  The  input  is  usually  general  information,  such  as 
the  trainee’s  name,  a  choice  of  how  the  instruction  should  continue,  or 
peripheral  requests  such  as  the  selection  of  a  trainee’s  record  output. 

2. 1.2. 2  Response  to  Instructional  Output 

The  problem  cue  or  review  cue  (2. 1.1.1)  is  the  heart  of  the  instructional 
process.  It  requires  the  trainee  to  enter  the  proper  QL  statement  or  answer(s) 
via  the  keyboard  as  required  by  the  format  of  the  cue  or  directions  with  the  cue. 
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2. 1.2. 3  Process  Step  Key  Interrupt 

There  will  be  times  during  the  instructional  process  when  the  trainee  may 

want  to  break  out  of  an  instructional  sequence  for  one  reason  or  another.  This 

will  be  permitted  at  times  by  the  lighting  of  certain  process  step  keys  which, 

when  pressed,  will  interrupt  the  ongoing  sequence  and  present  the  material  the 

trainee  desires.  The  lighting  of  keys  will  be  under  program  control.  The 

primary  example  of  this  is  the  SKIP  (^20^  which  is  described  in  Table  3  , 

(page  3-6).  Other  keys  of  this  type  are  HELP  (P,^)  and,  at  times,  REVIEW  (P^) 

iz  8 

and  TEXT  REFERENCE  (P^) . 

2. 1.2. 4  Request  Trainee  Record  Printout 

An  instructor  can  obtain  the  printout  of  a  trainee *s  record  by  starting 
the  QL  Instruction,  pressing  OLD  TRAINEE  ’  entering  the  trainee’s  name,  and 

pressing  TRAINEE  RECORD  (1^24^*  resulting  display  describes  different  kinds 

of  records.  The  kind  of  record  desired  can  be  determined  by  the  keyboard  entry 
(see  Figure  27,  page  3-49). 

2.2  Files 

Although  some  data  for  the  instructional  process  will  duplicate  that  of 
the  Query  Language  Capability,  it  must  necessarily  be  kept  separate  to  promote 
ease  of  accessing.  The  data  are  arranged  in  six  files  for  ease  of  description: 
trainee  record  file^  major  problem  file;  practice  problem  file;  review  file; 
text  reference  display  file;  and  general  cue  and  display  file.  (Operationally, 
these  may  be  divided  into  two  basic  files,  the  trainee  record  file  and  a  cue 
file  that  would  include  all  the  other  files.)  Since  the  whole  instructional 
program  is  intended  to  be  separate  from  the  operational  programs,  the  files 
associated  with  these  programs  are  kept  separate  from  each  other. 

The  files  will  be  arranged  in  a  combination  of  serial  and  matrix  file 
structures,  depending  upon  the  individual  file  considered.  However,  the  basic 
arrangement  will  use  a  serial  arrangement  of  major  topics  ,  but  with  each  topic 
containing  a  matrix  and/or  serial  arrangement  of  subtopics.  Some  samples  are 
diagrammed  in  Figure  1  (page  2-12)  .  During  the  use  of  the  program  all  files 
will  be  stored  on  disc.  However,  upon  termination  of  the  instruction  by  the 
CANCEL  AND  DEACTIVATE  ^(P^q)  key,  all  the  files  may  be  dumped  on  a  tape  used 
for  this  purpose  to  open  up  disc  storage  space  (if  this  is  necessary).  Or  the 
trainee  record  file  may  be  retained  in  disc  storage  and  the  other  files  dumped 
on  a  tape . 
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In  order  to  prevent  presentation  of  the  same  cue  twice  in  the  instructional 
process,  the  practice  problem  file  and  review  file  are  to  be  arranged  so  that 
if  a  cue  is  presented  to  a  trainee  it  will  not  be  presented  again  to  the  same 
trainee.  Figuratively,  this  may  be  done  in  the  following  way.  The  cues  in 
these  files  will  be  arranged  serially  in  categories,  and  the  categories  will 
be  arranged  serially  in  disc  storage.  Cues  within  the  categories  will  be  ar¬ 
ranged  so  that  they  can  be  rotated,  i.e.,  so  that  the  cue  on  **top**  is  used  when 
a  cue  from  that  category  is  required.  After  it  is  used  it  is  rotated  to  the 
bottom  of  the  list  and  an  unused  cue  remains  on  top.  When  the  program  requires 
a  cue  of  a  given  type  from  a  given  category,  the  cue  ”on  top**  is  always  used. 

If  the  list  of  cues  is  exhausted,  the  first  -  presented  cue  may  then  be  used. 
However,  a  sufficient  number  of  cues  will  be  stored  to  limit  this  possibility  to 
only  extreme  situations. 

Since  the  rotation  of  cues  within  a  category  will  differ  with  each  trainee, 
depending  upon  his  progress  in  the  instruction,  the  rotation  arrangement  will  be 
*'remembered**  by  the  computer  for  each  trainee.  In  practice,  the  cues  themselves 
would  not  be  moved,  but  just  the  pointers. 

2.2.1  Trainee  Record  File 

Each  trainee  record  file  will  contain  the  data  specified  in  Figure  2, 
page  2-13,  and  will  be  organized  in  the  manner  specified  by  the  figure.  Three 
dimensions  of  data  will  be  used;  category,  kind  of  measurement,  and  section 
of  the  instructional  sequence.  In  addition,  the  trainee* s  stopping  point  and 
the  rotational  arrangement  of  cues  will  be  stored  in  this  file. 

i 

2. 2. 1.1  Category 

Data  will  be  accumulated  for  each  category  of  Query  Language  on  the  other 
two  dimensions  to  provide  an  indication  of  improvement  or  weakening  of  perform¬ 
ance  within  each  category  at  different  stages  of  the  program  for  each  trainee. 

2. 2. 1.2  Kind  of  Measurement 

The  kinds  of  measurements  used  for  data  collection  are  the  following: 

A.  Trials  attempted 

1.  Total  number  of  trials  attempted  (e.g.,  cues  responded  to, 
number  of  occurrances  within  a  problem,  etc.) 

2.  Number  of  trials  incorrect 

3.  Percent  of  trials  incorrect 
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B.  Response  times  (latencies) 

1.  Sum  of  assigned  maximum  response  times  for  trials  attempted 

2.  Sum  of  obtained  response  times 

3.  Number  of  cues  for  which  a  response  time  exists  that  were  attempted 

4.  Number  of  cues  on  which  the  maximum  time  was  exceeded 
5*  Percent  of  cues  on  which  the  maximum  time  was  exceeded 

C.  Aids  used 

1»  Total  number  of  times  an  aid  (HELP  or  the  use  of  TEXT  REFERENCE 
or  REVIEW)  was  available 

2.  Number  of  times  an  aid  was  used 

3.  Percent  of  times  an  aid  was  used 

D.  Overall  score  -  a  value  calculated  for  each  category  and  over  all 
categories  that  is  a  function  of  the  weighted  scores  of  percent 
trials  incorrect,  percent  cues  with  excess  time,  and  percent  aids 
used.  The  weightings  given  to  each  measure  will  be  empirically 
determined . 


2. 2. 1.3  Section  of  Instructional  Sequence 

The  two  dimensions  of  data  described  in  2. 2. 1.1  and  2. 2. 1.2  will  be  stored 
for  each  of  three  stages  in  the  instructional  program,  the  pretest,  the  primary 
problems,  and  the  posttest,  as  well  as  for  all  the  material  used  (overall).  The 
data  for  the  three  stages  of  the  instruction  will  be  stored  only  on  the  problems 
and  will  not  include  data  on  remedial  sequences  of  any  kind.  This  will  permit 
direct  comparisons  between  trainees  on  identical  material  and  also  provide  a 
measure  of  the  improvement  of  a  trainee  over  time. 


2.2.2  Major  Problem  File 

This  file  will  consist  of  the  twenty  English  Language  requests  for  informa¬ 
tion  (problem  cues)  from  which  the  Query  Language  statements  are  composed  by 
the  trainee.  These  will  be  numbered  and  stored  in  order.  In  addition,  ten 
preprogram  problem  cues,  presented  to  a  new  trainee  (one  who  has  not  entered 
the  computer-directed  training  before)  to  assess  his  abilities,  and  ten  post¬ 
program  test  problem  cues  will  be  stored  in  order  with  their  answers  and  ex¬ 
pected  latencies.  Access  to  these  three  sets  of  programs  is  serial  in  .nature. 

In  addition  to  the  usual  information  stored  with  a  problem,  the  primary  problem 
cues  also  have  a  partial  output  display  stored  which  is  similar  to  that  which 
would  be  generated  if  the  Query  had  been  actually  processed. 
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2.2.3  Practice  Problem  File 


This  file  will  be  composed  of  problem  cues  which  focus  on  a  specific  cate¬ 
gory  of  the  language.  These  will  be  stored  under  their  appropriate  category. 

The  number  stored  for  each  category  will  be  dependent  upon  the  expected  number 
needed  throughout  the  program  for  that  category. 

Practice  problems  are  to  be  stored  with  their  category  code,  answer,  ex¬ 
pected  latency,  and  code  of  the  corresponding  help  sequence. 

2.2.4  Review  File 

The  review  file  will  contain  sets  of  review  cues  that  consist  of  sentences 
that  will  require  the  trainee  to  fill  in  a  missing  word.  These  review  cues, 
or  ^frames,**  are  to  be  used  to  refresh  the  trainee’s  memory  on  a  certain  point 
of  Query  Language  which  he  may  have  forgotten.  Because  a  sequence  of  frames 
will  be  required  for  each  review,  the  frames  are  to  be  stored  by  sets  under 
the  proper  category  code.  Access  to  the  frames  will  be  by  set  rather  than  by 
individual  frame  (diagrammed  in  Figure  3,  page  2-14).  Each  frame  will  be  stored 
with  its  answer  and  expected  response  latency  and  will  be  stored  in  a  fixed 
position  within  the  set.  The  set  will  be  stored  with  the  category  code  refer¬ 
ring  to  the  whole  set.  Thus,  each  set  will  be  handled  like  a  practice  problem 
(2.2.3),  i.e.,  the  sets  will  rotate  per  trainee,  the  frames  will  not. 

2.2.5  Text  Reference  Display  File 

This  file  will  contain  the  displays  which  refer  the  trainee  to  a  specific 
portion  of  the  programed  text.  These  displays  will  be  stored  serially  with 
their  category  code.  Only  a  few  displays  would  exist  for  each  category,  de¬ 
pending  upon  the  number  of  applicable  text  references  which  will  exist  for 
the  category. 

2.2.6  General  Cue  and  Display  File 

All  general  information  in  the  form  of  cues  or  displays  which  do  not  re¬ 
quire  the  matching  of  a  response  or  reference  to  some  external  information  is 
to  be  stored  in  this  file.  Information  which  is  interchangeable  (i.e.,  can  be 
used  in  equivalent  situations)  will  be  stored  under  a  common  heading  such  as 
Affirmative  Responses,  Negative  Responses,  etc.  Information  stored  under  head¬ 
ings  is  to  be  rotated  per  trainee  when  used  so  that  each  successive  presentation 
will  be  different. 
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2,3  Programs 

Seven  main  programs  are  shown  in  the  Functional  Data  Flow  Diagram  (Figure 
P^ge  2-16):  overlay  interpretation  program;  input-output  analysis  program; 
Query  checker  program;  retrieval  program;  student  record  maintenance  program; 
output  formatting  program;  and  data  load  program.  These  programs  will  be  dis¬ 
cussed  in  some  detail  in  the  following  sections. 

The  program  separation  given  above  is  an  attempt  to  break  down  the  computer 
activities  into  discrete  parts.  However,  except  for  the  Data  Load  Program,  all 
the  programs  must  work  together  as  a  whole  and  depend  upon  each  other.  The 
overall  instructional  activity  is  shown  as  it  relates  directly  to  the  trainee 
in  the  Procedural  Flow  Diagram  (Figure  32,  page  A-3) .  A  possible  process  for 
the  internal  operation  and  organization  of  the  instructional  sequence  has  been 
diagrammed  in  the  flow  charts  found  in  Appendix  B.  A  description  of  the  purpose 
and  function  of  these  flow  charts  is  provided  in  the  appendix.  Although  the 
seven  programs  discussed  here  are  not  directly  referenced  by  the  flow  charts, 
their  function  in  the  operation  of  the  program  should  be  clarified  by  the 
charts . 

2.3.1  Overlay  Interpretation  Program 

This  program  interprets,  processes,  and  codes  all  inputs  from  the  CCC . 

It  discriminates  between  A/N  keyboard  and  process  step  key  inputs,  encodes  the 
inputs  into  the  proper  machine  language  for  processing,  and  channels  the  input 
to  the  right  place  in  the  program  according  to  its  form  (i.e.,  A/N  keyboard  or 
process  step  key).  It  also  utilizes  all  applicable  CCC  maintenance  programs 
that  are  required  for  the  operation  of  the  console. 

2.3.2  Input-Output  Analysis  Program 

This  program  deals  with  cue  and  overlay  inputs  from  the  trainee  and  all 
outputs,  to  the  trainee.  It  remembers  whether  the  output  was  a  review  cue  or 
a  problem  cue  and  passes  the  resulting  input  to  the  proper  program.  If  the 
input  is  a  problem  cue,  it  passes  it  on  to  the  Query  checker  program.  If  the 
input  is  a  review  cue,  this  program  compares  the  input  with  the  correct  answer. 
It  determines  the  next  output  on  the  basis  of  the  comparison  of  the  input  and 
the  trainee’s  prior  performance  (if  applicable).  It  also  records  the  result  of 
the  input  in  an  internal  storage  register  (the  trainee  record  maintenance  pro¬ 
gram,  section  2.3.5). 
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All  instructional  outputs  are  handled  by  this  program.  If  a  set  of  frames 
is  being  presented,  the  program  stores  the  set  and  handles  the  output- input 
until  the  set  is  complete  or  until  some  other  step  is  taken. 

2.3.3  Query  Checker  Program 

This  program  dissects  and  compares  in  detail  all  Query  Language  inputs 
(i.e.,  problem  cues  and  practice  problems)  with  a  stored  answer.  The  answer  is 
broken  down  into  its  component  parts  and  is  stored  in  table  form  (see  Figure  1, 
page  2-12).  The  inputted  statement  is  also  tabled  and  the  tabled  elements  are 
compared.  In  the  event  that  an  input  is  sufficiently  incorrect  to  prohibit 
tabling,  a  letter  by  letter  serial  comparison  can  be  used  to  test  for  correct 
elements . 

Each  element  of  the  answer  has  a  specific  category  code  associated  with 
it.  Two  sets  of  accumulators  for  all  the  categories  and  the  sum  over  all  cate¬ 
gories  are  established  for  each  Query  input  on  a  temporary  basis,  one  to  regis¬ 
ter  each  error  that  is  found  in  each  category.  For  example,  if  an  element  that 
belongs  in  category  6  occurs,  the  occurrance  register  for  that  category  as  well 
as  the  summary  register  are  increased  by  one.  If  that  element  is  found  in 
error,  the  error  register  for  that  category  and  the  summary  error  register  are 
increased  by  one.  This  system  permits  a  calculation  of  the  percent  of  error 
for  each  category  as  well  as  an  overall  percentage  for  the  whole  input.  The 
results  of  these  calculations  of  percentages  and  the  measure  of  the  trainee’s 
general  performance  form  the  basis  for  determining  the  output  or  sequence  of 
outputs  that  will  follow  the  Query  input.  A  more  detailed  picture  of  these 
processes  may  be  gained  from  the  flow  charts  in  Appendix  B.  See  especially 
the  subroutine  QCHEK  (pageB"<^0« 

2.3.4  Retrieval  Program 

All  disc  file  accesses  are  handled  by  this  program.  Inputs  from  the  over¬ 
lay  interpretation  program,  input-output  analysis  program,  and  Query  checker 
program  are  analyzed  by  the  retrieval  program  to  determine  what  data  is  re¬ 
quired.  These  inputs  will  usually  specify  the  kind  and  category  of  the  data 
required,  or  may  specify  a  specific  data  location.  This  data  is  located  and 
removed  from  the  disc  file,  assembled,  and  either  passed  to  the  input-output 
analysis  program  if  the  material  is  to  be  displayed  or  to  the  output  formatting 
program  if  the  material  is  to  be  printed.  File  data  is  not  erased  when  it  is 
removed . 
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This  program  is  also  responsible  for  the  rotating  of  the  file  data  if  it 
is  appropriate.  When  a  trainee  stops  the  instruction,  the  rotation  arrangement 
is  transferred  to  the  record  maintenance  file. 

2.3.5  Trainee  Record  Maintenance  Program 

This  program  is  responsible  for  the  maintenance  of  a  running  record  of  all 
phases  of  a  trainee* s  performance  which  are  listed  in  Section  2.2.1.  It  receives 
inputs  from  the  input-output  analysis  program  and  Query  checker  program  and  is 
accessed  by  the  retrieval  program.  This  program  also  keeps  a  running  check  on 
the  trainee’s  general  performance  category.  Every  time  the  value  of  a  running 
record  is  changed,  the  performance  value  is  recalculated  and  updated. 

Upon  termination  of  the  instructional  period,  this  program  assembles  the 
trainee’s  record  and  updates  the  trainee  record  file. 

2.3.6  Output  Formatting  Program 

This  program  takes  the  output  from  the  retrieval  program  and  formats  it 
according  to  prestored  formats  for  output  on  the  printer.  The  format  to  be  used 
is  determined  by  the  kind  of  information  specified  by  the  operators  input.  Two 
basic  formats  will  be  stored,  a  summary  output  format  for  the  trainee  record, 
and  a  complete  interaction  record  that  is  performed  by  the  standard  1401  (or 
1410)  logging  and  data  reduction  system. 

2.3.7  Data  Load  Program 

This  is  a  series  of  programs  that  edit  and  format  the  input  data  and  store 
it  in  the  proper  files  of  the  disc  storage.  Data  can  be  inputted  on  cards,  tape, 
or  through  the  keyboard  (using  the  standard  update  program).  Standard  date- load 
programs  may  be  used  for  this  purpose.  However,  due  to  the  nature  of  the  storage 
it  will  be  necessary  to  have  a  routine  to  load  data  in  the  proper  categories  and 
the  proper  place  in  the  categories  so  that  no  fixed  address  locations  are  dis¬ 
turbed.  In  addition,  the  data  load  program  is  used  when  data  is  dumped  on 
tape  from  disc  storage  and  when  it  is  transferred  back  to  disc  from  tape. 

2.4  Output 

The  Query  Language  Computer-Directed  Instructional  Program  is  designed  to 
have  three  kinds  of  outputs: 
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Instructional  Outputs 
Supportive  Outputs 
Performance  Outputs 

The  instructional  and  supportive  outputs  are  directed  toward  the  trainee,  the 
performance  output  is  generally  used  by  the  instructor.  Examples  of  all  the 
kinds  of  outputs  are  found  in  the  display  section,  Section  3.5. 

2.4.1  Instructional  Outputs 

These  outputs  are  actual  instructional  or  testing  material  which  consist 
of  problem  cues  (2. 1.1.1),  review  cues  (2. 1.1.1),  or  text  reference  displays 
(2. 1.1. 2).  The  problem  cues  and  review  cues  require  the  trainee  to  make  a  key¬ 
board  entry  which  is  compared  with  a  stored  answer;  the  text  reference  displays 
refer  the  trainee  to  external  textual  matter. 

2.4.2  Supportive  Outputs 

All  outputs  to  the  trainee  that  do  not  require  an  input  which  is  compared 
with  an  answer  are  classed  as  supportive  outputs.  These  include  general  cues 
(2.I.I.1)  and  displays  (2. 1.1.2)  which  may  tell  a  trainee  how  he  is  doing,  whether 
he  is  correct  or  incorrect,  or  give  him  a  choice  of  alternatives  for  continuing 
the  instructional  process  (e.g.,  practice,  review,  text  reference,  or  problem). 
Some  of  these  require  some  kind  of  input  and  others  are  just  informational. 

2.4.3  Performance  Outputs 

These  outputs  may  be  called  for  by  the  instructor  and  may  be  outputted  only 
through  the  printer.  They  present  in  printed  form  the  data  that  is  stored  in 
the  trainee  record  file  for  a  trainee,  or  in  summary  form  over  all  trainees. 

A  general  record  of  all  trainee-computer  interactions  may  also  be  obtained,  and 
it  may  be  desirable  to  obtain  a  tabulation  of  the  performance  of  all  trainees 
on  a  specific  cue  or  set  of  cues  (requested  through  card  input).  A  sample  per¬ 
formance  output  is  depicted  in  Figure  28,  page  3-50. 
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Fig.  1.  A  method  of  storage  for  problem  cues  and  review  cues 
that  includes  all  the  information  required  for  each  kind. 
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Figure  2.  The  three  dimensions  of  data  storage. 
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Fig.  3. 

Arrangement  of  review  sets  and  frames  in 

a  category 

The  term  **Frame'*  stands  for  the  stored  set  of  data  which  consists  of  the 
review  cue,  answer(s) ,  and  latency  (see  Figure  L) . 
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Figure  5.  Query  Language  Computer-Directed  Instruction  Functional  Data  Flow  Diagram. 


Chapter  3 


OPERATING  PROCEDURES 

This  chapter  describes  operating  procedures,  operating  aids,  program  bounds, 
and  error  checking  in  the  Query  Language  Computer-Directed  Instructional  Program. 

3.1  CCC  Operating  Procedures 

The  CCC  operating  procedures  for  using  the  QL  instructional  program  are 
described  in  both  general  and  specific  detail.  Two  basic  kinds  of  operator  re¬ 
sponses  are  possible:  process  step  key  and  A/N  keyboard.  The  heart  of  the 
instructional  process  is  the  presentation  of  cues  and  the  evaluation  of  the  A/N 
input.  The  overlay  provides  the  trainee  with  a  means  of  controlling  the  program 
if  he  so  desires  and  also  permits  the  simplification  of  some  program  processes 
(such  as  obtaining  trainee  records) . 

The  overlay  for  the  program  is  shown  in  Figure  6,  page  3-5.  Table  3,  page  3-6, 
describes  the  function  of  each  process  step  key.  The  CCC  Procedural  Flow  Diagram, 
shown  in  Figure  32,  page  A-3 ,  is  a  foldout  to  provide  easy  reference  during 
reading  of  the  procedural  sections.  Examples  of  all  outputs  are  included  in 
Section  3.5. 

3.1.1  A/N  Keyboard  Inputs 

A/N  keyboard  inputs  are  of  two  types,  responses  to  instructional  cues  or 
responses  to  general  cues.  All  keyboard  entries  are  made  in  response  to  some 
cue  . 

The  instructional  process  uses  the  normal  overlay  mode  input  procedures. 

The  trainee  reads  the  cue,  decides  what  he  wants  to  enter,  then  presses  ACTIVATE 
A/N  KEYBOARD  {^2^^  types  his  answer,  and  finally  submits  the  response  by 

pressing  ENTER  positioning  arrow  will  always  be  properly  placed 

during  typing  so  that  the  manipulation  of  the  arrow  by  the  trainee  will  be  held 
to  a  minimum.  Normal  keyboard  correction  procedures  are  used.^ 


For  a  description  of  standard  input  procedures  and  correction  procedures,  see 
Operational  Specification  for  Common  Control  Functions  for  OTC  Retrieval 
Facilities  (OS-OTC-22) . 
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The  type  of  input  required  will  be  clear  from  the  form  of  cue  displayed, 
and  the  cue  will  be  titled  to  provide  identification  (e.g.,  PRA.CTICE  PROBLEM, 
PRIMARY  PROBLEM  #5,  REVIEW  CUE,  etc.). 

3. 1.1.1  Inputs  in  Response  to  Instructional  Cues 

As  mentioned  earlier,  the  two  basic  kinds  of  instructional  cues  are  problem 
cues  and  review  cues  (2. 1.1.1).  The  A/N  input  for  a  problem  cue  is  a  Query 
Language  statement.  The  response  to  a  review  cue  is  a  word  or  words  which  either 
fill  in  blanks  left  in  the  cue  or  give  information  required  by  the  cue. 

3. 1.1. 1.1  Response  to  Problem  Cues 

The  input  to  a  problem  cue  is  typed  in  the  space  provided  below  the  cue 
(see  Figure  23,  page  3-A4).  Adequate  space  will  be  left  for  the  input.  The 
process  of  making  the  input  will  be  identical  to  that  of  entering  a  standard 
QL  statement  except  that  the  START  QUERY  (C^^)  key  will  not  be  used.  When  the 
trainee  is  ready  to  type  the  QL  statement  he  presses  ACTIVATE  A/N  KEYBOARD  (^2) 
and  starts  typing.  When  he  has  finished  he  presses  ENTER  (A^^) .  At  no  time 
will  he  have  to  change  the  position  of  the  positioning  arrow  except  in  the  case 
of  errors.  The  same  process  is  used  for  both  primary  problems  and  practice 
prob lems . 

3. 1.1. 1.2  Response  to  Review  Cues 

Review  cues  may  contain  blanks  within  the  body  of  the  text,  but,  for  sim¬ 
plicity  of  answering,  the  blanks  are  numbered  and  corresponding  blanks  are  pre¬ 
sented  vertically  below  the  text  (see  Figure  17,  page  3-38).  To  answer  these 
cues,  the  trainee  reads  the  cue,  determines  the  proper  answer,  presses  ACTIVATE 
A/N  KEYBOARD  (C2)  ,  ^nd  the  marker  arrow  appears  at  the  start  of  the  first  blank 
below  the  cue.  If  there  is  only  one  blank,  he  then  types  his  answer,  presses 

ENTER  (A^^)  ,  and  finally  presses  JUDGE  (^^25^  submit  his  answer  to  the  computer. 
A  slightly  more  elaborate  procedure  is  used  for  multi-response  cues. 

For  a  review  cue  with  more  than  one  frame,  the  trainee  types  in  his  answer 
to  the  first  blank  after  pressing  ACTIVATE  A/N  KEYBOARD  (^2^ *  then  presses 

ENTER  the  position  marker  moves  to  the  next  blank,  permitting  the 

trainee  to  type  in  his  answer  to  that  blank.  The  SKIP  ENTRY  (Cg)  key  is  lit 
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to  permit  the  trainee  to  skip  a  blank  if  he  desires.  All  the  blanks  are  filled 
in  in  this  manner.  When  the  trainee  is  ready  to  submit  his  answers  to  the  com¬ 
puter  for  judgment,  he  presses  JUDGE  (^25^  which  takes  him  out  of  the  response 
loop.  This  procedure  utilises  the  standard  procedure  for  filling  in  a  multi¬ 
blank  cue  generated  by  an  overlay. 

If  the  trainee  wishes  to  make  any  changes  in  his  answers,  he  simply  uses 
the  SKIP  ENTRY  (Cg)  key  to  get  to  the  blank  he  wishes  to  change,  and  retypes 
his  answer . 

3.1. 1.2  Inputs  in  Response  to  General  Cues 

The  only  general  cues  that  require  a  keyboard  input  are  the  initial  cue 
asking  the  trainee *s  name  (Figure  8,  page  3-26)  and  the  cues  that  request  the 
trainee  to  pick  a  category  or  categories  for  review  practice  material  (see 
Figure  14,  page  3-33).  These  cues  are  self-explanatory  to  the  trainee.  For 
both,  entries  are  made  in  the  manner  specified  for  similar  types  of  entries 
required  by  all  overlay-generated  cues.  For  cues  requiring  A/N  entries,  the 
input  procedure  is  like  that  for  review  cues  (3. 1.1. 1.2).  If  the  output  re¬ 
quires  the  selection  of  a  category  or  item  from  a  list,  the  input  procedure  is 
similar  to  chat  for  review  cues  with  multiple  entries  except  that  as  asterisk 
(*)  is  typed  in  front  of  the  category  or  item  desired.  More  than  one  item  may 
be  chosen  if  desired. 

3.1.2  Process  Step  Key  Inputs 

The  functions  of  each  of  the  process  step  keys  is  described  in  Table  3. 
These  keys  may  be  used  in  two  ways  ,  in  response  to  a  cue  or  as  a  program  over¬ 
ride  by  the  trainee.  A  key  may  be  activated  only  when  it  is  lighted,  and  the 
lighting  is  under  program  control.  START  (P^)  is  a  special  case  and  is  used 
as  in  other  overlays. 

3. 1.2.1  Key  Input  in  Response  to  a  Cue 

General  cues  usually  require  a  response  via  the  process  step  keys.  These 
cues  give  a  trainee  a  choice  of  different  continuations  in  the  instructional 
process  which  may  be  responded  to  by  pressing  YES  ^^14^’  TEXT 

REFERENCE  (P^)  ,  REVIEW  (Pg)  ,  PRACTICE  (P^)  ,  or  PROBLEM  (Pj^q);  NEXT  (Pj^^);  or 
CONTINUE  (Pj^^).  While  a  cue  is  displayed  only  the  indicated  key  choices  art 
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lighted,  and  only  these  may  be  pressed.  Upon  activation  of  one  of  them,  the 
lights  for  all  go  out  to  be  replaced  by  those  required  by  the  next  display. 

3. 1.2. 2  Key  Input  as  an  Overriding  Function 

During  the  presentation  of  an  instructional  cue,  one  or  more  process  step 
keys  which  interrupt  the  ongoing  sequence  may  be  lighted,  indicating  that  they 
may  be  pressed.  Examples  of  these  keys  are  HELP  SKIP  (^20^*  ^ 

problem  was  answered  wrongly,  the  TRY  AGAIN  be  available.  FINISHED 

(P^g)  is  usually  lighted  and  CANCEL  AND  DEACTIVATE  (P^q)  is  always  available  in 
the  event  of  an  emergency.  TRAINEE  RECORD  (^24^  lighted  as  an  option  during 

the  early  stages  of  the  program  but  is  not  referred  to  directly.  JUDGE  (^25^ 
is  a  utility  key  to  permit  the  trainee  to  enter  a  multi-response  cue. 

These  keys  have  one  thing  in  common  -  if  they  are  pressed  they  interrupt 
the  normal  sequence  of  the  program  to  continue  on  a  path  determined  by  the  oper¬ 
ator.  These  paths  may  vary,  as  can  be  seen  by  looking  at  the  descriptions  of 
the  keys  in  Table  3,  (page  3-6)^  but  they  all  give  the  trainee  a  degree  of  flexi¬ 
bility  which  is  designed  to  let  the  trainee  have  some  degree  of  control  over  the 
instructional  process. 
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Figure  6.  Query  Language  Computer-Directed  Instruction  Program  Overlay 


Table  3 

Query  Language  Computer-Directed  Instruction  Process  Step  Key  Functions 


P 


1 


Key  Designation 


START 


P 


2 


NEW 

TRAINEE 


P 


3 


OLD 

TRAINEE 


P 


7 


TEXT 

REFERENCE 


P 


8 


REVIEW 


Description 


This  key  signals  the  program  to  activate  the 
Query  Language  Computer-Directed  Instruction 
program  and  transfer  all  data  from  tape  to 
disc  if  necessary. 


This  key  signals  the  program  that  the  trainee 
signing  on  has  no  past  record,  and  that  the 
preprogram  set  of  problems  is  to  be  retrieved 
and  displayed  one  by  one.  A  display  request¬ 
ing  the  trainee's  name  is  to  be  displayed  next 
and  the  name,  when  entered,  will  title  a  new 
record  file . 


This  key  signals  the  program  that  the  trainee 
signing  on  has  a  record  in  the  record  file . 
The  display  requesting  the  trainee's  name  is 
to  be  retrieved  and  displayed.  After  the 
trainee's  name  is  entered,  the  proper  record 
is  to  be  retrieved  and  the  primary  problem  to 
be  presented  is  determined  for  this . 


This  key  signals  the  program  that  the  trainee 
wants  the  presentation  of  a  display  referring 
him  to  the  programed  text.  If  a  category  is 
already  active  in  the  input-output  analysis 
program,  the  display  for  that  category  is  re¬ 
trieved  from  the  text  reference  display  file 
and  displayed  (Figure  15).  If  no  category  is 
active,  a  cue  to  determine  who  chooses  the 
category  (Figure  13)  is  displayed.  Once  the 
category  is  chosen,  the  material  is  retrieved 
and  displayed. 


This  key  signals  the  program  that  the  trainee 
wishes  the  presentation  of  a  review  sequence. 

The  determination  of  the  category  and  retrieval 
and  display  process  is  similar  to  that  which 
results  from  the  TEXT  REFERENCE  (Fy)  ^^y  except 
that  responses  to  the  cues  are  obtained  and  the 
sequence  is  handled  by  the  input-output  analysis 
program.  The  sequence  is  retrieved  from  the 
review  file.  (See  Figure  17  for  a  sample  output.) 


3-6 


Table  3  (con't,) 


Key  Designation 


P 


9 


PRACTICE 


P 


10 


PROBLEM 


P 


12 


HELP 


P 


13 


YES 


P 


14 


NO 


P 


16 


NEXT 


Description 


This  key  signals  the  program  that  the  trainee 
wants  the  presentation  of  practice  problems. 
The  process  is  similar  to  that  which  results 
from  the  REVIEW  (Pg)  key  except  that  retrieval 
is  from  the  practice  problem  file  and  the  re¬ 
sponses  are  analyzed  by  the  Query  checker  pro¬ 
gram.  (See  Figure  20  for  a  sample  output.) 


This  key  signals  the  program  that  the  trainee 
desires  the  presentation  of  a  primary  problem. 
The  proper  problem  is  determined  and  displayed 
(see  Figure  23  for  an  example)  and  the  input 
is  analyzed  and  handled  by  the  Query  checker 
program . 


This  key  signals  the  program  that  the  trainee 
wants  the  help  sequence  accompanying  the  prac¬ 
tice  problem  cue  being  displayed.  This  cue  is 
removed  and  the  help  sequence  specified  inter¬ 
nally  by  the  cue  set  is  retrieved  and  presented 
The  input- output  analysis  program  handles  the 
sequencing  of  the  cues  and  the  inputs  from  the 
cues  and  determines  the  continuation  of  the 
instructional  process  on  the  basis  of  the 
trainee *s  success  with  the  sequence  (i.e.,  upon 
successful  completion  the  interrupted  cue  is 
again  presented,  but  upon  unsuccessful  comple¬ 
tion,  a  remedial  process  may  be  initiated). 

(See  Figure  17  for  a  sample  output.) 


This  key  signals  the  program  that  the  trainee 
will  select  a  category  or  categories  for  re¬ 
medial  work.  A  display  listing  the  categories 
is  retrieved  and  displayed  from  which  the  trainee 
chooses  the  category(s)  (Figure  14). 


This  key  signals  the  program  that  the  choice 
of  the  next  instructional  material  is  to  be 
made  internally  by  the  program.  This  choice 
is  based  upon  the  trainee’s  prior  performance 


This  key  signals  the  program  that  the  next  dis¬ 
play  in  the  predetermined  sequence  is  to  be  pre¬ 
sented.  Its  function  is  to  just  move  along  in 
the  sequence . 
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Table  3  (con*  t . ) 


Key  Designation 


Description 


P 


17 


CONTINUE 


P 


19 


TRY 

AGAIN 


P 


20 


SKIP 


This  key  signals  the  program  to  retrieve  the 
next  set  of  materials  in  the  instructional 
sequence  and  display  the  first  of  the  set,  or 
to  present  the  next  display  in  a  sequence 
already  initiated.  The  key  is  lighted  at 
choice  points  where  the  trainee  may  either  get 
off  the  computer  or  continue  the  program. 


This  key  signals  the  program  to  re-present  the 
cue  that  was  just  responded  to  by  the  trainee. 
It  is  lighted  only  if  the  input  is  incorrect 
and  the  input  was  the  first  incorrect  response 
to  the  cue . 


This  key  signals  the  program  to  present  the 
primary  problem  cue  from  which  the  remedial 
sequence  being  presented  was  derived.  It  in¬ 
structs  the  program  to  remember  where  the  on¬ 
going  process  was  interrupted  until  the  primary 
problem  is  analyzed.  If  the  input  to  the  prob¬ 
lem  is  correct,  the  remedial  material  is  re¬ 
turned  to  storage  and  the  instruction  sequence 
continues  from  the  correct  input.  If  the  re¬ 
sponse  is  incorrect,  the  sequence  resumes 
where  it  left  off.  For  the  trainee,  this  key 
provides  the  opportunity  to  skip  the  remainder 
of  a  remedial  sequence  if  he  believes  he  can 
answer  the  problem  correctly. 


P 


2A 


TRAINEE 

RECORD 


P 


25 


JUDGE 


This  key  signals  the  program  to  retrieve  and 
print  out  the  performance  record  of  the  trainee 
whose  name  was  entered.  It  is  intended  for  use 
by  the  instructor  who  is  interested  in  the 
progress  of  the  trainee.  The  immediate  output 
from  this  key  is  a  display  of  choices  of  output 
content.  The  choice  is  followed  by  the  printout 


This  key  signals  the  program  to  break  out  of 
a  response  loop  on  the  CCC  and  accept  the  re¬ 
sponse  for  comparison  with  the  stored  answer, 
i.e.,  ’’judge”  the  input,  or  to  take  action  as 
specified  by  the  program  in  control.  The 
continuation  is  under  program  control  and  de¬ 
pends  upon  the  success  of  the  answer  and  its 
position  within  the  sequence  of  cues. 
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Table  3  (con*  t . ) 


Key  Designation 


Descr iption 


P 


26 


FINISHED 


P 


28 


RESTART 


This  key  signals  the  program  that  the  trainee 
is  finished  with  his  turn  on  the  computer  but 
that  another  trainee  will  follow.  The  trainee’s 
record  is  updated;  the  number  of  the  primary 
problem  on  which  the  trainee  is  working  (or 
the  next  one  if  the  current  one  is  completed) 
is  stored  with  the  record.  Any  material  which 
had  been  retrieved  from  the  files  is  restored, 
and  the  programs  are  cleared  for  the  next  trainee. 


This  key  signals  the  program  to  return  to  the 
beginning  of  the  sequence  of  instruction  wi th- 
out  pressing  START  (P^)  again. 


P 


30 


CANCEL 

AND 

DEACTIVATE 


This  key  signals  the  program  to  cancel  the  in¬ 
struction,  update  the  trainee’s  record,  store 
the  number  of  the  primary  problem  being  worked 
on  (or  the  next  one  if  the  present  one  is  com¬ 
pleted)  ,  restore  the  material  being  worked, 
cancel  any  printouts,  and  deactivate  the  over¬ 
lay  . 
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3.2  Operator  Aids 

Aids  to  the  trainee  to  assist  in  his  progress  through  the  instructional 
program  are  needed  in  case  the  trainee  needs  to  determine  the  proper  abbrevia¬ 
tion  or  legal  attribute  or  value  in  the  writing  of  the  QL  statements.  The 
following  473L  documents  will  be  needed. 

•  System  Vocabulary  -  This  document  lists  all  legitimate  computer  abbre¬ 
viations  and  all  legitimate  modifiers,  attributes,  and  their  respective  values 
and  ranges  of  values. 

♦  Data  Base  Definition  -  Defines  items,  values  for  items,  and  the  struc¬ 
ture  in  which  this  data  will  be  formatted  in  the  data  base. 

3.3  Capability  Bounds 

The  Query  Language  Computer-Directed  Instruction  program  is  designed  for 
maximum  speed  and  flexibility  of  interaction  between  the  trainee  and  the  com¬ 
puter  and  has  no  bounds  upon  data  because  of  its  instructional  purpose.  The 
program  is,  in  essence,  a  closed  program  with  its  own  data  base  and  its  own 
basic  routines,  but  it  does  utilize  the  common  input-output  routines  for  the 
CCC. 

Running  times  for  the  program  are  flexible,  although  a  single  period  of  in¬ 
struction  should  not  exceed  two  hours  or  be  less  than  20  minutes.  The  scheduling 
of  trainees  for  successive  instructional  periods  is  recommended  to  minimize  the 
repeated  shifting  of  the  program  in  and  out  of  core  which  would  result  if  the 
instructional  periods  were  separated. 

The  number  of  cues  stored  for  each  QL  category  is  theoretically  limited 
only  by  the  storage  space  available  on  disc,  but  it  is  practically  limited  to 
the  maximum  expected  number  needed  by  any  given  trainee  during  the  full  course 
of  instruction  (see  Figure  4).  Provision  is  made  for  the  repetition  of  cues  in 
extreme  cases.  The  repetition  of  a  cue  presented  earlier  in  the  course  of  in¬ 
struction  should  not  be  detrimental  in  any  way  to  the  instruction. 

3.4  Error  Checks 

Because  the  whole  design  of  the  Computer-Directed  Instruction  program  is 
based  on  checking,  processing,  and  rectifying  errors,  no  additional  error  checks 
are  needed.  The  system  has  been  designed  to  eliminate  the  possibility  of 
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peripheral  operator  errors  which  could  defeat  the  purpose  of  the  program  (i.e., 
typing  in  the  wrong  place,  wrong  word,  etc.)-  If  tihe  trainee  makes  a  spelling 
error,  it  will  be  treated  as  if  it  were  a  wrong  response  and  should  make  the 
trainee  more  careful  in  typing  the  inputs. 

3.5  Cue  Displays  and  Output  Formats 

In  this  section,  all  types  of  displays  used  in  the  Query  Language  Computer- 
Directed  Instruction  program  are  described,  and  each  format  specified.  For  each 
kind  of  output,  the  format,  rules  for  locating  entry  positions,  and  exceptions 
will  be  specified,  i.e.,  the  location  for  the  start  of  the  text,  the  start  and 
extent  of  the  entries,  beginning  column  for  entries,  etc.  Samples  of  each  kind 
of  display  are  provided  at  the  end  of  this  chapter.  Each  display  shown  is  just 
a  sample  from  a  number  of  displays,  each  of  which  may  appear  at  one  or  more 
points  during  the  course  of  instruction.  However,  each  display  possible  for  a 
given  situation  will  be  similar  in  format  and  otherwise  conform  to  the  specifi¬ 
cation  stated  in  the  description  of  the  cue  type. 

3.5,1  Specifications  Common  to  All  Cues  and  Displays 

a.  All  outputs  used  for  the  instructional  program  will  be  unclassified. 

The  word  UNCLASSIFIED  will  appear  in  the  first  and  last  row  starting 
in  column  1. 

b.  Every  output  will  have  a  title  in  the  second  row  starting  in  column  1. 

c.  If  the  cue  or  display  is  one  of  a  set  of  more  than  one  pages,  the  page 
number  and  total  number  of  pages  included  in  the  output  will  be  speci¬ 
fied  on  the  first  row  starting  on  column  29  and  will  use  the  format 
(PAGE  NUMBER)  OF  (TOTAL  NUMBER  OF  PAGES).  All  cues  followed  by  another 
page  will  have  the  words  GO  ON  TO  THE  NEXT  PAGE  in  row  19  starting  on 
column  10. 

d.  The  names  of  process  step  keys  and  control  keys  will  appear  in  quota¬ 
tion  marks. 

e.  The  text  will  be  blocked  in  one  sentence  units.  Each  sentence  will 
start  in  column  1  and  on  the  second  row  below  the  previous  sentence. 

f.  The  last  row  that  will  be  used  for  text  will  be  row  18,  unless  the  last 
line  of  text  would  be  line  19  ^nd  there  are  no  following  pages.  If  there 
are  no  additional  pages  and  row  19  would  be  the  last  line  of  text,  that 
row  may  bo  used. 
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3.5.2  Problem  Cues  (Q^  , 


a.  Major  problem  cues  consist  of  primary  problems,  pretest  problems, 
and  post test  problems. 

b.  The  start  of  the  text  will  be  column  1  of  row  4, 

c.  The  input  will  start  on  the  second  row  below  the  end  of  the  text, 

on  CO lumn  1 . 

d.  For  major  problem  cues,  eight  (8)  rows  will  be  allotted  for  the  answer. 

e.  For  practice  problem  cues,  five  (5)  rows  will  be  allotted  for  the  answer. 

f.  Row  19  may  be  used  for  the  answer,  but  not  for  the  text. 

g.  If  there  is  insufficient  room  for  the  answer  on  the  same  page  as  the 
text,  the  whole  answer  should  be  placed  on  the  next  page. 

h.  Primary  problems  will  be  tit  led '^PRIMARY  PROBLEM  (number  of  problem)," 

i.  Pretest  problems  will  be  titled  "PRETEST  PROBLEM  (number  of  problem)." 

j.  Posttest  problems  will  be  titled  "POSTTEST  PROBLEM  (number  of  problem)." 

k.  Practice  problems  will  be  titled  "PRACTICE  PROBLEM." 

l.  The  title  will  appear  on  each  page  of  the  output. 

3.5.3  Review  Cues  (Frames) 

a.  The  start  of  the  text  will  be  column  1  of  row  4. 

b.  The  first  part  of  the  text  will  be  standard  directions  for  answering 

the  question. 

c.  For  single  response  frames,  the  directions  will  read:  TYPE  IN  THE 
ANSWER  AND  THEN  PRESS  "ENTER." 

d.  For  multi-response  frames  (i.e.,  frames  containing  more  than  one 
blank),  the  directions  will  read;  PRESS  "ENTER"  AFTER  YOU  TYPE  IN 
EACH  ANSWER.  AFTER  YOU  HAVE  TYPED  IN  ALL  THE  ANSWERS,  PRESS  "JUDGE." 

e.  If  more  than  one  blank  appears  in  a  frame,  each  blank  will  be  numbered 
sequentially,  with  a  corresponding  number  associated  with  an  answer 
blank . 

f.  Answer  blanks  will  be  below  the  text.  The  first  blank  will  be  on  the 
second  row  below  the  end  of  the  text. 

g.  Answer  blanks  will  be  numbered  if  there  is  more  than  one  blank.  The 
numbers  will  be  in  column  1  and  the  response  will  start  in  column  3. 

One  whole  line  from  column  3  through  column  30  will  be  allowed  for 
each  answer . 


3-12 


h.  If  Lhei't'  is  only  one  answer,  it  will  not  be  numbered,  but  the 
answer  will  start  on  column  3. 

L.  One  answer  line  will  be.  provided  for  each  answer  blank  in  the  frame, 

j.  There  will  be  no  row  spacing  between  answers. 

k.  If  there  is  not  enough  room  for  all  the  answer  blanks  below  the  text, 

all  answer  blanks  will  appear  on  the  next  page. 

l.  Row  19  may  be  used  for  an  answer  blank. 

m.  Review  cues  will  be  titled:  REVIEW  CUE  -  (category  name). 

3.5.4  Text  Reference  Displays 

a.  The  text  will  start  on  column  1  of  row  4. 

b.  The  first  part  of  the  text  will  be  standard  directions  for  using 
the  display. 

c.  The  directions  will  read:  PLEASE  READ  THE  FOLLOWING  SECTION  IN 
THE  PROGRAMED  TEXT.  COPY  THE  REFERENCE  ON  A  SHEET  OF  PAPER. 

d.  The  reference  will  consist  of  four  parts,  the  category  of  the  refer¬ 
ence,  the  chapter  in  the  text,  the  part  of  the  chapter,  and  the  frame 
numbers  referenced. 

e.  The  category  listing  will  start  in  column  4  on  the  second  row  below 
the  directions. 

f.  The  chapter  number  will  start  on  column  5  on  the  row  beneath  the 
category . 

g.  The  part  reference  will  be  on  the  row  beneath  the  chapter  and  will 
start  in  column  6. 

h.  The  frame  numbers  will  start  on  column  7  on  the  row  beneath  the  part. 

i.  The  words  GO  ON  TO  THE  NEXT  PAGE  will  appear  in  row  19  starting  in 
column  10. 

j.  The  display  will  be  titled  TEXT  REFERENCE. 

k.  The  output  for  the  text  reference  will  consist  of  at  least  two  frames. 
The  last  frame  will  be  a  listing  of  continuation  options  which  will 

be  described  in  Section  3.5.7. 

3.5.5  General  Cues  that  Require  Inputs  (Q2 j  ^15’  ^16^ 

a.  The  text  will  start  on  column  1  of  row  4. 

b.  The  cue  title  will  be  stored  with  the  cue. 
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c.  For  cues  that  require  alphanumeric  input  (such  as  the  entry  of  a 
name)  ,  the  input  will  start  on  the  third  row  below  the  end  of  the 
text  and  will  extend  from  column  1  through  column  30. 

3. 5. 5.1  General  Cues  that  Require  the  Selection  of  Items  (Asterisk  Inputs) 

«15' 

a.  The  list  of  items  will  start  on  the  second  row  below  the  end  of  the 
descriptive  text  and  will  be  single  spaced. 

b.  The  entry  position  for  the  asterisk  will  be  in  the  first  column. 

c.  The  first  letter  of  each  item  in  the  list  will  be  in  column  3. 

d.  If  an  item  runs  for  more  than  one  row,  the  second  row  will  start 
with  column  3 . 

e.  Row  19  may  be  used  for  an  item  if  that  item  is  the  last  in  the  list. 

f.  If  more  than  one  page  is  needed  for  the  output,  the  directions  and 
descriptive  text  will  appear  on  the  first  page  and  the  list  of  items 
will  appear  on  the  second  page. 


3.5.6  General  Cues  with  Program-Generated  Outputs  (Q.  ,  ,  D  Dot,)  D  ) 

O  y  zA  ZD  J 

a.  The  text  will  start  on  column  1  of  row  4. 

b.  The  last  row  used  for  text  will  be  row  18. 

c.  The  cue  title  will  be  stored  with  the  cue. 

d.  For  cues  that  require  a  word  fill-in,  space  is  left  in  the  stored 

cue  (sec  Q, ) . 

o 

e.  If  a  confirmation-negation  cue  is  to  be  superimposed  upon  an  answer 
display,  the  confirmation-negation  cue  will  be  presented  on  row  4 
starting  on  column  1;  the  answer  cue  will  provide  the  title  and  will 
start  on  row  7  in  column  1  (see  D  D  ,  D  ). 

ZA  ZD  j 

f.  If  the  cue  is  a  list  of  topics  with  an  indication  of  the  topic  to  be 
worked  on,  the  indicator  will  be  the  marker  arrow  in  column  1,  and  the 
topics  will  start  in  column  3.  The  list  of  topics  i>7ill  be  single 
spaced.  Any  text  following  tht*  list  of  topics  will  start  on  the 
second  row  below  the  last  topic  (see  Q^) . 
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3.5.7  Gonoral  Cues  with  No  Keyboard  Input  or  Variable  Output  j  ; 

Qg.  Qg,  Qj^2’  ^13’  ^14’  ^17’  *^1’  *^4’  *^5^ 

a.  The  text  will  start  on  column  1  of  row  4. 

b.  The  last  row  used  for  text  will  be  row  18. 


3. 5. 7.1  Special  Case  (D^) 


a.  If  the  output  is  a  simulated  display  following  the  input  of  a  Query 
statement,  the  display  will  start  on  row  3  and  no  title  will  appear 
in  row  2 . 

b.  Titles,  if  any,  will  be  centered  and  placed  according  to  directions 
with  the  cue . 

c.  The  output,  excepting  the  title,  will  be  double  spaced. 

d.  Data  will  be  left  justified. 

e.  Each  column  of  data  will  start  on  the  column  three  columns  to  the  right 
of  the  last  character  of  the  preceding  column. 

f.  Other  rules  governing  the  output  of  data  from  inputs  on  Query  mode 
will  be  followed  for  these  outputs. 


3.5.8  Pr intouts 


3. 5. 8.1  Trainee  Performance  Summaries  (P/0^) 


a.  The  trainee  performance  summary  printout  will  consist  of  four  pages, 
one  each  for  the  overall  performance,  the  pretest  problems,  the  pri¬ 
mary  problems,  and  the  posttest  problems. 

b.  The  title  of  the  page  will  start  in  column  1  of  row  2. 

c.  The  word  UNCLASSIFIED  will  appear  in  row  1  starting  with  column  1. 

d.  The  page  number,  using  a  format  described  in  Section  3.5.1  will  appear 
on  the  first  row  starting  in  column  124. 

e.  The  trainee* s  name  or  the  word  SUMMARY  will  be  on  row  3  starting  in 
column  50. 

The  column  headings  will  be  shown  in  P/O^. 

g.  The  numerical  data  for  each  column  will  start  one  column  to  the  right 
of  the  first  character  of  the  column  heading  and  will  be  right  justi¬ 
fied.  Leading  zeroes  will  be  suppressed. 
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h. 

The  row  headings  will  start  in  column  1. 

1. 

j  • 

The  first  column  heading  will  start  on  row  8. 

The  basic  column  headings  will  consist  of  OVERALL  through  CAT  15  and 

k. 

will  be  single  spaced.  The  headings  to  be  used  are  shown  in  P/O^. 

The  row  heading  GENERAL  PERFORMANCE  -  (topic  of  page)  will  appear  on 

row  25,  and  will  be  followed  on  that  row  by  the  SCORE  starting  in 

column  50,  and  the  DESCRIPTION  starting  with  column  70. 

3. 5. 8.1 

. 1  Overall  Performance  Page. 

a . 

The  page  title  will  be  TRAINEE  PERFORMANCE  SUMMARY  -  OVERALL  PERFORMANCE 

b. 

The  row  heading  STOPPING  POINT  will  be  on  row  27.  On  the  same  row,  the 

word  PROBLEM  NN  will  start  in  column  50. 

c . 

The  page  topic  will  be  ALL  MATERIALS, 

3. 5. 8.1 

.2  Pretest  Problem  Page 

a  . 

The  page  title  will  be  TRAINEE  PERFORMANCE  SUMMARY  -  PRETEST  PROBLEMS. 

b. 

The  page  topic  will  be  PRETEST  PROBLEMS. 

3.5.8. 1 

.3  Primary  Problem  Page 

a  . 

The  title  of  the  page  will  be  TRAINING  PERFORMANCE  SUMMARY  -  PRIMARY 

PROBLEMS. 

b. 

The  page  topic  will  be  PRIMARY  PROBLEMS. 

3. 5. 8.1 

.4  Posttest  Problem  Page 

a . 

The  page  title  will  be  TRAINEE  PERFORMANCE  SUMMARY  -  POSTTEST  PROBLEMS. 

b. 

The  page  topic  will  be  POSTTEST  PROBLEMS. 

3. 5. 8. 2 

Trainee-Computer  Interaction  Record 

a . 

The  format  for  this  printout  is  that  determined  by  the  standard  1401 

or  1410  logging  and  data  reduction  program. 

3.6  Operational  Example 

This  material  details  a  representative  instructional  sequence  which  a  given 
trainee  might  follow  in  taking  the  Computer-Directed  Instructional  program. 
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Since  the  possible  Instructional  paths  increase  exponentially  once  the  trainee 
has  started,  only  a  fev>?  paths  will  be  followed.  The  possible  variations  at  the 
choice  pc'jints  encountered  will  be  discussed,  but  usually  only  one  variation 
will  be  followed. 

The  following  text  provides  an  operational  example  of  the  flow  of  events 
diagrammed  in  the  Query  Language  Computer-Directed  Instruction  CCC  Procedural 
Flow  Diagram  (Figure  32,  page  A-3). 

1.  The  trainee  places  the  QL  instruction  overlay  in  position,  presses 

the  START  (F^)  >  and  obtains  the  welcoming  display  (Figure  7, 

page  3-24).  Because  this  is  his  initial  entry  into  the  instructional 
program,  he  presses  the  NEW  TRAINEE  (P^)  in  response  to  the  in¬ 

structions  in  Figure  7  (if  he  had  started  the  Instructional  program 
previously,  he  would  have  pressed  OLD  TRAINEE,  response  to 

the  resultant  cue  (Figure  8,  page  3-26)  the  trainee  types  his  name  on 
the  A/N  Keyboard  and  enters  it,  using  the  standard  entry  procedure 
(Press  ACTIVATE  A/N  KEYBOARD,  C^ ,  type  the  input,  and  press  ENTER,  A^^. 
This  procedure  is  used  for  all  keyboard  entries  mentioned  in  this  text.). 
He  is  then  presented  with  the  instruction  cue  (Figure  9,  page  3-27)  and 
presses  NEXT  (Fj^^)  ^fter  reading  the  instructions. 

2.  A  series  of  10  pretest  problems  (Figure  10,  page  3-29)  are  presented 
one  at  a  time.  The  trainee  reads  the  first  problem,  formulates,  types, 
and  enters  the  Query  statement  he  thinks  will  retrieve  the  information 
desired;  the  next  problem  then  appears.  He  continues  reading  and  an¬ 
swering  until  all  the  problems  have  been  presented.  At  any  time  during 
this  (and  any  other)  sequence  he  may  stop  by  pressing  FINISHED  (F2^) 

if  another  trainee  is  to  be  next  on  the  console,  or  CANCEL  AND 
DEACTIVATE  (F^q)  if  a  trainee  is  not  next  or  if  an  emergency  occurs. 

If  the  trainee  stops  during  the  pretest,  the  problem  on  which  he  is 
working  will  be  remembered  by  the  computer  and  he  will  start  with  that 
problem  when  he  returns  to  the  program. 

3.  After  the  trainee  answers  the  last  pretest  problem,  a  cue  (Figure  11, 
page  3-30)  appears  telling  him  how  he  did  on  the  previous  problems 
(VERY  WELL,  GOOD,  YOU  NEED  SOME  PRACTICE)  and  what  options  he  can 
choose  (i.e.,  continue  or  stop).  Our  trainee  wishes  to  continue  with 
the  instruction:  he  presses  CONTINUE  (F^^y)  and  obtains  the  next  in¬ 
structional  cue  (Figure  12,  page  3-31). 
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4.  The  procedure  option  cue  (Figure  12,  page  3-31  )  tells  the  trainee  that 

he  may  review  some  areas  of  Query  Language  (press  REVIEW,  P  ) ,  practice 

o 

on  some  simple  QL  problems  (press  PRACTICE,  Lg)  ,  obtain  a  text  refer¬ 
ence  (press  TEXT  REFERENCE,  P^) ,  or  proceed  with  the  primary  problem 
(press  PROBLEM,  •  The  keys  accessing  these  options  are  lighted 

until  one  of  them  is  pressed.^  He  may  obtain  material  on  any  phase 
of  Query  Language  he  desires.  We  will  look  at  each  of  the  remedial 
possibilities  before  continuing  with  the  primary  problem. 

a.  The  trainee  presses  the  TEXT  REFERENCE  (P^)  key. 

i.  The  resultant  display  (Figure  13,  page  3-32  )  gives  the  trainee 
the  option  of  choosing  the  area  of  Query  Language  he  would  like 
to  study  (YES,  ^ letting  the  computer  choose  the  topic 
(NO,  presses  YES  (P^^^  types  an  asterisk  by  each 

of  his  choices  on  the  following  display  (Figure  14,  page  3-33) 
which  lists  only  the  QL  categories  relevant  to  the  primary  prob¬ 
lem  to  be  presented.  He  may  choose  as  many  topics  as  he  desires 
if  they  are  listed.  JUDGE  (^23^  used  to  submit  his  choices 
to  the  computer. 

ii.  The  output  (Figure  15,  page  3-35)  gives  the  text  reference(s) 
and  the  option  of  stopping  or  continuing.  References  appear  on 
different  frames  of  the  output.  In  this  way,  the  trainee  can 
obtain  the  text  reference  if  he  wants  it  but  need  not  take  time 
out  from  his  computer  time  to  read  it.  Of  course,  he  could  stop 
if  he  wanted  to.  Our  trainee  wants  to  continue  on  the  computer, 
so  he  writes  down  the  text  reference  and  presses  CONTINUE  (Pj^y)  • 
The  following  cue  (Figure  15,  page  3-35)  lists  the  different 
possibilities  for  continuing  (REVIEW,  P^;  PRACTICE,  Pg ;  PROBLEM, 

^10^  • 

b.  The  trainee  presses  REVIEW  (P^)  and  chooses  the  category(s)  he  would 

o 

like  to  review  by  the  procedure  described  in  Section  4.a.i  above 
(Figure  13,  etc.).  After  he  has  chosen  the  category,  the  review 
frames  are  presented  in  sequence.  A  frame  (or  review  cue,  Figure 
17,  page  3-38)  is  displayed,  the  answer  is  typed  in  the  appropriate 


If  a  key  option  is  mentioned  in  a  cue,  that  key  is  lighted  and  available  for 
the  duration  of  the  cue. 
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spacG(s),  and  the  response  is  entered  by  pressing  JUDGE  (P^^)  . 

The  answer  is  judged  and  the  correct  answer,  along  with  a  comment 
on  the  correctness  of  the  answer,  appears  in  a  display  (Figure  17, 
page  3-38).  The  trainee  presses  ADVANCE  DISPLAY  FRAME  (C^^)  ,  ob¬ 
tains  the  next  cue,  and  answers  it.  He  continues  in  this  manner 
until  he  answers  the  last  frame.  If  he  had  made  two  or  more  errors 
on  the  review  sequence,  a  text  reference  display  (Figure  14,  page  3-33) 
would  be  presented  for  that  category  and,  if  he  had  been  doing  poorly 
in  the  instruction,  there  would  be  no  possibility  for  continuing  with 
the  program  (the  CONTINUE,  ^ey  would  be  unlit).  During  the 

succession  of  frames  the  SKIP  (^20^  is  lighted  when  possible. 

This  permits  a  trainee  who  feels  that  he  has  had  enough  review  to 
break  out  of  the  review  sequence  and  go  directly  to  the  primary 
problem,  and  is  an  important  instance  in  which  the  trainee  is  given 
limited  control  over  his  instruction. 

If  the  trainee  requested  (or  the  computer  programmed)  review  in¬ 
cludes  more  than  one  category,  the  frames  for  the  categories  run 
successively  (if  the  work  was  satisfactory),  the  categories  being 
identified  by  headings  on  the  frames.  The  last  answer  display  is 
followed  by  a  cue  (Figure  19,  page  3-40)  that  lists  the  options 
available  for  continuing  (if  the  trainee  had  made  two  or  more  errors 
in  any  one  sequence  the  final  display  would  be  a  text  reference 
display).  Again,  he  has  the  option  of  stopping,  choosing  remedial 
material,  or  going  on  to  the  problem.  Our  hypothetical  trainee 
would  like  to  try  some  practice  problems  before  plunging  into  the 
primary  problem. 

c.  The  trainee  presses  the  PRACTICE  (Pg)  key  and  again  chooses  the 
categories  he  would  like  to  work  on  by  the  procedure  described  in 
Section  4.a.i,  (Figure  13,  etc.).  After  the  category  is  chosen,  a 
practice  problem  (Figure  20,  page  3-41)  appears.  The  trainee  is 
not  sure  he  can  write  the  correct  Query  so  he  asks  for  help  by 
pressing  the  HELP  (available  and  lighted  only  for  prac¬ 

tice  problems).  This  results  in  the  presentation  of  a  series  of 
frames  like  Figure  16,  page  3-37 (similar  to  the  review  described 
in  Section  4.b)  which  will  specifically  help  with  the  problem  he 
is  working.  If  too  many  mistakes  are  made  on  the  ’’help*’  sequence. 
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a  review  sequence  will  be  initiated  which  deals  more  intensively 

with  the  trouble  area  than  does  the  "help"  sequence.  The  review 

presented  is  the  same  as  if  the  ElEVIEW  (Pq)  key  had  been  pressed, 

o 

but  the  last  output  would  be  the  practice  problem  with  which  the 
sequence  was  initiated.  Once  the  help  sequence  is  successfully 
completed,  the  same  practice  problem  is  presented  again.  No  more 
help  sequences  are  available  (HELP,  Pj^2’  lifi^t  out).  The  trainee 
composes,  types,  and  enters  his  answer  and  it  is  judged  by  the  com¬ 
puter.  If  the  answer  is  incorrect,  the  resulting  display  (Figure 
22,  page  3-43),  tells  the  trainee  he  is  incorrect.  If  this  is  the 
first  attempt  at  the  problem,  the  trainee  is  given  the  option  of 
attempting  the  problem  again  by  pressing  the  TRY  AGAIN  (Pj^g)  key. 
Pressing  this  key  restores  the  problem  to  the  display  screen.  If 
the  answer  is  incorrect  a  second  time,  a  review  sequence  dealing 
with  the  trouble  area  is  initiated  (there  is  no  option)  and  the 
continuation  is  that  described  in  4.b  above.  (The  problem  which 
was  failed  is  presented  as  the  last  frame  of  the  review  sequence.) 

If  the  first  or  second  answer  to  the  problem  is  correct,  the 
resulting  display  (Figure  21,  page  3-42)  tells  the  trainee  he  is 
correct.  The  next  display  will  be  a  cue  (Figure  19,  page  3-40) 
giving  the  trainee  the  different  options  for  continuing.  Our 
trainee  feels  ready  for  the  primary  problem. 

5.  PROBLEM  is  pressed  and  the  primary  problem  (Figure  23,  page  3-44) 

appears  on  the  display  screen.  The  PElACTICE  (Pf.)  j  REVIEW  (Pq)  ,  ^nd 

9  o 

TEST  REFERENCE  (P^)  keys  are  lighted  in  case  the  trainee  wants  any 
remedial  work  on  an  area  in  which  he  is  still  uncertain.  When  he 
activates  the  keyboard,  the  key  lights  go  out,  and  he  types  and  enters 
the  QL  statement.  If  the  answer  Ls  correct,  a  partial  display 
(Figure  24,  page  3-45)  of  the  data  which  would  be  retrieved  by  the 
statement  is  presented  as  the  first  frame.  (This  partial  answer 
would  be  stored  with  the  problem.)  The  second  page  of  the  output 
is  a  cue  (Figure  25,  page  3-46)  displaying  the  options  for  contin¬ 
uing.  If  the  trainee  wishes  to  continue,  pressing  CONTINUE 
initiates  the  sequence  starting  with  Section  4  (Figure  12,  etc.). 

If  necessary,  of  course,  he  may  stop. 
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6.  If  Lho  answer  to  the  problem  is  wrong,  the  following  cue  (Figure  26, 

page  3-47)  lists  the  categories  in  which  errors  were  made.  These 

categories  are  dealt  with  one  at  a  time  .  The  marker  arrow  indicates 

which  area  is  being  reviewed  at  a  given  time.  When  work  on  that  area 

is  satisfactorily  completed,  the  marker  moves  down  to  the  next  area. 

The  marker  is  initially  placed  at  n  general  category  in  which  an  error 

was  made  (i.e.,  Process  Director,  Qualifier,  or  Selector).  The 

trainee  may  choose  a  review  sequence  or  text  reference  covering  the 

category  listed  in  the  cue  by  pressing  REVIEW  (Pq)  or  TEXT  REFERENCE 

o 

(P^) .  Or  he  can  let  the  computer  determine  the  next  step  by  pressing 
NO  (P^^). 

The  option  to  try  the  problem  again  is  available  to  those  trainees 
who  have  been  doing  well  in  the  program  and  only  on  the  first  presenta¬ 
tion  of  the  cue. 

a.  The  trainee  presses  TEXT  REFERENCE  (P^)  .  The  text  reference  is  dis¬ 

played  along  with  instructions  for  the  next  step  (Figure  15,  page  3-35). 
If  the  text  reference  display  was  chosen  as  an  option  or  if  the 
trainee  had  been  doing  weJ  1 ,  the  CONTINUE  will  be  lighted. 

Pressing  this  key  will  return  the  trainee  to  the  procedure  starting 
with  Section  6,  above,  but  with  the  omission  of  the  ’’try  again” 

option  (again,  this  is  so  that  the  trainee  can  utilize  the  time 
allotted  him  on  the  computer  if  he  so  desires)  .  Otherwise  ,  the 
trainee  will  be  permitted  to  complete  the  remedial  material  that 
has  been  programmed,  then  he  must  stop  and  work  on  the  text. 

b.  The  trainee  presses  REVIEW  (P^)  .  A  frame  (review  cue.  Figure  17, 

o 

page  3-38)  is  displayed.  The  trainee  types  and  enters  his  answer 
and  receives  feedback  (Figure  18,  page  3-39)  in  the  form  of  a  com¬ 
ment,  the  correct  answer,  and  instructions  to  go  to  the  next  page. 

This  sequence  of  frames  is  continued  until  completion.  Poor  per¬ 
formance  (i.e.  ,  two  or  more  wrong  answers)  results  in  the  display 
of  the  text  reference  and  a  stop  when  the  trainee  has  completed 
the  remedial  material.  If  his  performance  was  satisfactory,  the 
next  step  in  the  remedial  material  is  initiated. 

During  each  display  the  SKIP  (P2q)  may  be  on,  permitting 

the  trainee  to  skip  the  review  if  he  believes  he  knows  the  answer 
to  the  primary  problem.  This  option  is  available  only  to  satisfactory 
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trainees,  and  will  immediately  display  the  problem  (Figure  22, 
page  3“43).  If  the  answer  to  the  problem  is  correct,  the  trainee 
continues  along  the  ’’correct”  path  (see  Section  5).  If  not,  he 
is  returned  to  the  frame  where  he  left  off. 

Upon  successful  completion  of  the  review  sequence,  the  last 
answer  display  is  followed  by  Figure  26,  page  3-47,  (and  the  proce¬ 
dure  described  in  Section  6  is  repeated)  or  by  the  primary  problem 
(Figure  23,  page  3-44;  Section  5).  The  choice  of  continuation  is 
determined  by  the  computer  in  the  following  manner. 

If  the  trainee  makes  errors  in  a  primary  problem,  all  the  errors  are  classi¬ 
fied  and  some  kind  of  remedial  material  must  be  presented  for  each  category  in 
which  an  error  was  made.  The  computer  will  continue  to  present  this  material 
(going  through  Figure  26  for  each  category)  until  every  category  has  been  cov¬ 
ered.  At  this  point,  the  primary  problem  (Figure  23)  is  re-presented  and  the 
trainee  attempts  to  answer  it  correctly  again. 

c.  If  the  trainee  presses  NO  (Pj^^)  when  presented  with  Figure  26,  a 
variety  of  displays  could  occur  depending  upon  the  prior  perform¬ 
ance  of  the  trainee.  If  his  performance  was  not  good,  the  following 
display  is  determined  by  the  program  and  could  be  a  text  reference 
(Section  6. a.)  or  a  review  sequence  (Section  6.b.).  Otherwise,  the 
trainee  is  presented  with  Figure  26  with  the  marker  arrow  moved  to 
a  specific  category  in  which  a  mistake  was  made  (e.g..  Major  Item 
Secondary)  and  giving  him  a  choice  of  continuations.  Our  trainee 
lets  the  computer  decide  the  course  of  action  by  pressing  NO  (Pj^^) 
again . 

The  computer  may  now  display  a  text  reference  (Section  6. a.) 
or  review  sequence  (Section  6.b.)  dealing  with  the  problem  area. 

It  can  also  present  a  practice  problem  (Figure  20,  page  3-41)  if 
the  trainee  has  been  doing  well.  Let  us  look  at  the  practice  prob¬ 
lem  continuation,  which  is  similar  to  that  in  Section  4.c.  The 
trainee  may  ask  for  help  on  the  problem  as  he  did  in  Section  4.c. , 
and  with  the  same  results.  If  performance  is  poor  he  is  given 
either  a  text  reference  (Figure  15,  page  3-35)  or  a  review  sequence 
(Figure  17,  page  3-38).  Successful  completion  returns  the  practice 
problem  to  the  display  screen.  If  the  problem  is  answered  incor¬ 
rectly,  Figure  22  appears  and  the  trainee  may  try  again  by  pressing 
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TRY  AGAIN  Lighted)  ,  or  he  may  be  presented  with  the  reme¬ 

dial  displays  (see  Sections  6. a,  or  6.b.)*  if  the  answer  is  cor¬ 
rect,  the  SKIP  (^20^  lighted  during  the  confirmation  display 

(Figure  21,  page  3-42).  If  no  key  is  pressed,  this  display  is  fol¬ 
lowed  by  either  Figure  26  (see  Section  6)  or  by  the  primary  problem 
(see  Section  5).  The  computer  determines  the  display  by  using  the 
procedure  described  above. 

7.  After  the  trainee  has  correctly  answered  all  the  primary  problems,  the 

resultant  display  (Figure  24,  page  3-45)  for  the  last  problem  is  followed 
by  a  cue  (Figure  29,  page  3-54)  which  informs  the  trainee  that  a  test 
consisting  of  ten  problems  will  follow.  It  is  recommended  that  the 
test  be  taken  immediately,  but  the  trainee  can  stop  if  necessary.  Our 
hypothetical  trainee  will  take  the  test;  he  presses  CONTINUE 

The  first  test  problem  (Figure  30,  page  3-56)  is  presented,  the 
trainee  composes  and  enters  his  answer,  the  next  problem  is  displayed, 
and  so  forth.  If  the  trainee’s  overall  test  performance  is  less  than 
satisfactory  after  the  fifth  problem  is  completed,  the  answer  to  this 
problem  is  followed  by  the  cue  (Figure  26,  page  3-47)  listing  the  cate¬ 
gories  in  which  errors  were  made  for  all  the  posttest  problems,  and 
the  continuing  sequence  is  that  described  in  Section  6.  All  errors 
in  all  the  test  problems  attempted  are  dealt  with  in  this  remedial 
sequence . 

Upon  completion  of  the  remedial  material,  all  the  problems  missed 
are  presented  again  and  the  test  sequence  is  continued.  If  the  over¬ 
all  performance  drops  below  satisfactory  with  any  problem  after  the 
fifth,  the  remedial  sequence  is  initiated  as  described  above. 

After  successful  completion  of  all  the  test  problems,  the  final 
display  (Figure  31,  page  3-58)  informs  the  trainee  that  he  is  finished 
with  all  the  instruction. 
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APPENDIX  A 


Procedural  Flow  Diagram 

The  Procedural  Flow  Diagram  has  been  designed  to  provide  as  clear  a 
picture  of  the  various  external  sequences  of  events  as  possible.  Decision 
points  are  labelled  and  explained  at  points  where  the  flow  appears  to  go 
in  many  directions  at  once.  This  is  necessary  for  this  program  because 
there  is  no  one  fixed  sequence  of  events.  The  external  displays  and  choices 
may  vary  on  the  basis  of  many  internal  performance  factors  and  the  sequence 
followed  by  one  operator  will  seldom  resemble  the  sequence  taken  by  another 
operator . 

The  numbers  below  correspond  to  a  numbered  line  on  the  Procedural  Flow 
Diagram.  The  text  for  each  number  describes  the  requirements  for  the  program 
to  take  that  particular  path.  Since  the  normal  flow  is  downward,  only  the 
requirements  for  branches  will  be  described  if  their  purpose  is  unclear. 

Since  the  purpose  of  some  different  branches  is  the  same,  the  same  number 
reference  will  be  used. 

1.  The  trainee  has  not  completed  the  pretest  and  must  complete  it  before 
continuing  with  the  program. 

2.  The  trainee  is  ready  for  or  is  in  the  posttest. 

3.  Another  problem  or  cue  follows  in  the  sequence. 

4.  Trainee  presses  FINISHED  (1^26^  ^30’ 

5.  All  problems  are  completed  and  the  posttest  is  to  start. 

6.  The  trainee  made  more  than  a  specified  percentage  of  errors  and  is  sent 
to  the  remedial  sequence. 

7.  Possible  only  if  CONTINUE  Is  lit.  P^  is  lit  if  the  trainee's  over¬ 

all  performance  is  rated  good  or  fair  or  if  the  sequence  was  initiated 
by  pressing  TEXT  REFERENCE  (P^) . 

8.  The  trainee  may  still  choose  a  practice  problem  or  review  sequence. 

9 .  An  excess  percentage  of  errors  were  made  in  the  sequence .  The  trainee 
is  sent  to  a  more  intensive  sequence  (i.e.,  practice  to  review  and 
review  to  teach) . 

10.  The  sequence  is  completed  and  the  next  set  of  material  may  be  presented. 
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11.  The  sequence  is  finished,  or  the  trainee  presses  a  process  step  key 

^^17’  ^26’  ^30^ ■ 

12.  Return  from  a  ’’SKIP*’  process  to  a  practice  problem  set. 

13.  Return  from  a  ’’SKIP”  process  to  a  review  cue  set,  or  a  continuation  to 
the  next  category  of  remedial  materials. 

14.  Possible  only  if  CONTINUE  (P^)  is  lit.  P^^  is  lit  only  if  the  trainee’s 
overall  performance  is  rated  good  or  if  the  sequence  was  initiated  by 
pressing  TEXT  REFERENCE  (Py)  ,  or  if  remedial  material  remains. 

15.  The  computer  chooses  a  text  reference  display. 

16.  A  review  sequence  is  chosen  by  the  computer. 

17.  If  the  trainee  was  doing  well,  the  computer  repeats  but  with  a  more 
specific  category  indicated,  i.e..  Delimiter,  Value,  GCD ,  etc. 

18.  The  computer  chooses  a  practice  problem  set. 

19.  The  remedial  material  has  been  completed  and  the  trainee  is  ready  for 
the  problem  again. 

20.  At  the  completion  of  a  remedial  sequence  for  one  category,  is 
displayed  with  the  next  category  marked. 

21.  Always  lit  at  this  point  of  the  program. 

22.  P^^  is  lit  and  available  if  the  trainee’s  overall  performance  is  good,  or 

if  the  trainee’s  performance  is  fair  and  the  sequence  was  initiated  by  the 

trainee.  It  is  lit  conditionally  if  more  remedial  sequences  remain  (i.e., 
a  halt  is  programmed  for  the  point  where  the  remedial  sequences  are 
finished) . 

23.  Lit  only  once  for  each  problem  if  it  is  answered  incorrectly. 

24.  Only  one  HELP  sequence  available  for  each  problem. 

25.  The  review  sequence  was  initiated  by  an  unsuccessful  performance  on  the 

HELP  sequence,  and  the  problem  is  to  be  re-presented  as  the  last  cue. 
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APPENDIX  B 


General  Program  Flow  Charts 

These  flow  charts  provide  a  detailed  description  of  a  possible  method  for 
programming  the  sequences  described  in  this  Operational  Specification.  Main 
routines  and  subroutines  have  been  designed  to  attempt  to  take  into  account 
every  possible  variation  that  can  occur  in  the  program. 

The  first  four  charts  contain  the  main  sequence  of  events.  The  rest  of 
the  charts  are  subroutines  that  are  required  by  the  main  routine  and/or  by  other 
subroutines . 

Explanatory  notes  are  added  to  appropriate  pages  of  the  charts  to  clarify 
a  meaning  if  it  may  appear  vague  or  if  unusual  terms  are  introduced.  However, 
some  common  definitions  and  factors  influencing  the  program  are  described  below. 

During  the  course  of  the  program,  CANCEL  AND  DEACTIVATE  ^nd  FINISHED 

^^26^  are  lighted  at  all  times  that  other  process  step  keys  are  lighted.  Thus, 
this  state  is  not  reflected  in  the  flow  charts.  Also,  the  automatic  rotation 
of  review  and  practice  problem  cues  is  not  reflected. 

The  comparison  values  provided  in  the  flow  are  arbitrary  and  are  subject 
to  change  on  the  basis  of  experience.  Therefore,  their  inclusion  is  not  an 
indication  of  the  final  criteria  to  be  used  for  comparisons. 

When  a  sequence  of  cues  or  a  problem  is  presented  to  the  student  and 
responded  to,  the  number  of  possible  errors  in  each  category  for  the  sequence 
or  problem  is  added  to  the  appropriate  registers  automatically.  In  addition, 
for  each  instructional  output  a  set  of  temporary  registers  for  category  and 
overall  accumulation  is  automatically  established.  Thus,  these  are  not 
specified  in  the  following  flow  diagrams. 

The  terms  "register"  and  "accumulator"  may  be  used  interchangeably  at  times, 
but  a  register  is  usually  used  to  indicate  a  storage  location  where  data  is 
temporarily  stored,  and  an  accumulator  is  a  storage  location  that  is  used  to 
sum,  or  contain  data  that  may  be  successively  added  to. 

When  the  term  "word"  is  used,  it  is  used  in  the  sense  of  a  discrete  set 
of  characters  that  may  contain  more  than  one  conventional  words  and  that  may 
be  separated  by  some  symbol. 
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Figure  33.  START  and  RESTART  routines 


B-.2 


/pRtr/^ 


C  ^  <r^r 

- -  p .  - 

CirT  frt-te<r 

pr<»b/rm  1 

cprctf  i^a 

fi  ^(5 

i Aitf 

\neKT  prefer  r 

pr/5  U  1 1 


\  ohech 

\  dJCHEK  / 

_:i;' . 

\9t^rc  re^viT^ 
/n  rrrtM-rr< 

Ui'le 


T 


^s^aneC  ck^c.k., 

\OCHEK 


CAjeJt  «r 
^Iaka 

ftrtt  pfrhr^ 

M  C  C--  * 


wr 

p^F  .  y 

/ _ 

3r  ^Cl.Ou'MfUAN 

/  K  etrifi/e, 
/frjl  it^j 

Qy. 


?\ac€  a  i 

/n  ptrpblf^ 

it 


Figure  34. 


PRETA  and  PRETB  subroutines. 
B-3 


PKO& 


Figure  35.  PROB  subroutine 
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Figure  36.  PROBA  subroutine 
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Figure  40.  WAIT  subroutine 
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Figure  41.  PERF  subroutine 
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Figure  42,  CHOOS  subroutine 
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Figure  43.  TRUE  subroutine 
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Figure  44.  P^  PRACTICE  subroutine 
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Figure  45,  PRAC  subroutine 
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Figure  46.  A  subroutine  (for  PRAC  and  Pg  PRACTICE) 
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Figure  49.  REVPR  subroutine 
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Figure  50.  TEXT  REFERENCE  and  TECHA  subroutines 
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Figure  53.  CMPAR  subroutine 


B-22 


-\f  •%  J  ^  f 

F  h  ^  . 


''^aifk' 


J^.. 


I’' 


^  <*  r  f 
■f  c*  ^  . 

tur 


■  r»*  *'4^  *  r 

K/I  <  K 

f  M  ^  V  V  r  •^ . 


n  A  c  H 


'iThr'ck 

fvf}t'  »''i  y 

••v 


\; 


p  c  r  5 


ne  X  r 

fffot  »i  r 


^|<»**  »  5 

*1  ^ 


Record  ft  f/’r~ 
fer  f 

f*\  k*-c/ , 


/  //'<  r  / fdr  •k/inX 
/r! t  rt  *  \ 

\  r*  f  O  t  •■y  r<»/4;W 

'  f  /  IJ5  7 

UAcUy 


> — ^ 

K  e  ecrr  ef 

HiS 

(Ci^htrvr 

C  hr£  h 

i  <  td  *  t  i  *u  a  ^*<j^ 

\  p  r  L5 


(  Af  I  P  y  ^  it  f<vj,y 


^  fi**'  r 

1 1  HU Y  r- 
f  L  k  IVi  4-k 

fV/s  ^  ff  T. 


rpr^* 

PitP 

"peTT 


m, 

4  €  ii*^  I  t#*^  / 


.n\ss 


Figure  54.  QUALS  subroutine 
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Figure  58.  GCDQ  subroutine 
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Figure  59.  SELS  subroutine 
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Figure  60.  GENS  subroutine 
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Figure  62.  MACH  subroutine 


B-31 
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Figure  o7.  Computer  Communications  Console  Control  Panel 

Diagram  with  Query  Language  Instruction  Overlay 
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